Data Modeling and Hybrid Query for Video Database

Video data management is important since the effective use of video in multimedia applications is often impeded by the difficulty in cataloging and managing video data. Major aspects of video data management include data modelling, indexing and querying. Modelling is concerned with representing the structural properties of video as well as its content. A video data model should be expressive enough to capture several characteristics inherent to video. Depending on the underlying data model, video can be indexed by text for describing semantics or by their low-level visual features such as colour. It is not reasonable to assume that all types of multimedia data can be described sufficiently with words alone. Although query by text annotations complements query by low-level features, query formulation in existing systems is still done separately. Existing systems do not support combination of these two types of queries since there are essential differences between querying multimedia data and traditional databases. These differences cause us to consider new types of queries. The purpose of this research is to model video data that would allow users to formulate queries using hybrid query mechanism. In this research, we define a video data model that captures the hierarchical structure and contents of video. Based on this data model, we design and develop a Video Database System (VDBS). We compared query formulation using single types against a hybrid query type. Results of the hybrid query type are better than the single query types. We extend the Structured Query Language (SQL) to support video functions and design a visual query interface for supporting hybrid queries, which is a combination of exact and similarity-based queries. Our research contributions include a video data model that captures the hierarchical structure of video (sequence, scene, shot and key frame), as well as high-level concepts (object, activity, event) and low-level visual features (colour, texture, shape and location). By introducing video functions, the extended SQL supports queries on video segments, semantic as well as low-level visual features. The hybrid query formulation has allowed the combination of query by text and query by example in a single query statement. We have designed a visual query interface that would facilitate the hybrid query formulation. In addition we have proposed a video database system architecture that includes shot detection, annotation and query formulation modules. Further works consider the implementation and integration of these modules with other attributes of video data such as spatio-temporal and object motion

Systematic review and classification of video surveillance systems.

Recently,various conferences and journals have published articles related to Video Surveillance Systems, indicating researchers‘ attention. The goal of this review is to examine the latest works were published in journals, propose a new classification framework of video surveillance systems and investigate each aspect of this classification framework.This paper provides a comprehensive and systematic literature review of video surveillance systems from 2010-2011, extracted from six online digital libraries using article‘s title and keyword. The proposed classification framework is expanded on the basis of architecture of video surveillance systems, which is composed of six layers: Concept and Foundation Layer, Network Infrastructure Layer, Processing Layer, Communication Layer, Application Layer, and User interaction Layer. This review shows, although many publication and research focus on real-time aspect of the challenge, only few researches have investigated the deployment of extracted and retrieved information for forensic video surveillance

Impact of mobile context-aware applications on human computer interaction

The rapid growth of technological advances and availability of mobile devices has raised the opportunity to innovate feasible context-aware applications with the ability to access information anywhere and anytime. Therefore, this paper intends to review the recent developed mobile context-aware application. The reviewed articles are selected based on their application domains which cover the following six categories: smart space, healthcare, advertising, mobile guide, memory aid and disaster alerting applications. The selected applications are discussed based on their designed techniques, simulations and areas to show their impact on human computer interaction

Object detection and representation method for surveillance video indexing

The huge volume of videos produced by surveillance cameras has increased the demand for the fast and effective video surveillance indexing and retrieval systems. Although environmental condition such as light reflection, illumination changes, shadow, and occlusion can affect the indexing and retrieval result of any video surveillance system, nevertheless the use of reliable and robust object (blob) detection and representation methods can improve the performance of the system. This paper presents a video indexing module, which is part of a video surveillance indexing and retrieval framework, to overcome the above challenges. The proposed video indexing module is composed of seven components: background modeling, foreground extraction, blob detection, blob analysis, feature extraction, blob representation, and blob indexing. The experimental results showed that the selection of appropriate blob detection method could improve the performance of the system. Moreover, the experiments also demonstrated that the functionality of the proposed blob representation method was able to prevent the processing of redundant blobs' information

A study on surveillance video abstraction techniques

The goal of surveillance video abstraction is to generate a video abstract that includes important events and object by eliminating the redundant frames, lacking from activity in original video. Although many research and progresses have been done in video abstraction, the developed approaches either fail to accurately and effectively cover the overall visual content of video or they are computationally expensive in term of time or process. In this paper, firstly we critically review the applicable video abstraction techniques in surveillance domain based on our hierarchical classification, and then briefly introduce a new approach for generating a static surveillance video abstraction, which mitigate the drawbacks of reviewed approaches

A framework for caching relevant data items for checking integrity constraints of mobile database

In a mobile environment, due to the various constraints inherited from limitations of wireless communication and mobile devices, checking for integrity constraints to maintain the consistent state of mobile databases is an important issue that needs to be addressed. Hence, in this paper we propose a framework for caching relevant data items needed during the process of checking integrity constraints of mobile databases. This is achieved by analyzing the relationships among the integrity tests (simplified form of integrity constraints) to be evaluated for a given update operation. This improves the checking mechanism by preventing delays during the process of checking constraints and performing the update. Hence, our model speeds up the checking process

XIPS : a model-based prevention mechanism for preventing blind XPath injection in database-centric web services environment.

Web services have become a powerful interface for backend database systems which provides many services such as automatic purchasing, inventory tracking and clinical management. However, along the benefit of Web services, comes a serious risk of security breaches. Most Web services are deployed with security flaws and these vulnerabilities expose them to XPath (XML Path Language) injection. This kind of attack can cause serious damage to the database at the back end of Web services. This paper proposes XIPS, a prevention mechanism against Blind XPath injection attacks within Web services environment. The prevention mechanism employs the model-based approach to detect malicious queries and thwart them before they are executed on the Web services back end database. This approach uses run time monitoring to check on the dynamically-generated queries and compares them against the statistically-built model. The employment of the XIPS architecture should be able to prevent Web services from any kinds of XPath injection attacks

Model-based system architecture for preventing XPath injection in database-centric web services environment

Web services have become a powerful interface for back-end database systems. It is a self-describing component that can be used by other applications in a platform-independent manner. However, along the benefit of Web services, comes a serious risk of security breaches. Most web services are deployed with security flaws and these vulnerabilities make them exposed to XPath (XML Path Language) injection. This kind of attack can cause serious damage to the database at the backend of web services. This paper proposes a system architecture for prevention mechanism against XPath injection attacks within web services. The prevention mechanism employs the model-based approach to detect malicious queries and prevent them before they are executed on the web services backend database. This approach uses runtime monitoring to check on the dynamically-generated queries and compares them against the statistically-built model

Speeded up surveillance video indexing and retrieval using abstraction

Many researches have been conducted on video abstraction for quick viewing of video archives, however there is a lack of approach that considers abstraction as a pre-processing stage in video analysis. This paper aims to investigate the efficiency of integrating video abstraction in surveillance video indexing and retrieval framework. The basic idea is to reduce the computational complexity and cost of overall processes by using the abstract version of the original video that excludes unnecessary and redundant information. The experimental results show a significant reduction of 87% in computational cost by using the abstract video rather than the original video in both indexing and retrieval processes

An integrated semantic-based approach in concept based video retrieval

Multimedia content has been growing quickly and video retrieval is regarded as one of the most famous issues in multimedia research. In order to retrieve a desirable video, users express their needs in terms of queries. Queries can be on object, motion, texture, color, audio, etc. Low-level representations of video are different from the higher level concepts which a user associates with video. Therefore, query based on semantics is more realistic and tangible for end user. Comprehending the semantics of query has opened a new insight in video retrieval and bridging the semantic gap. However, the problem is that the video needs to be manually annotated in order to support queries expressed in terms of semantic concepts. Annotating semantic concepts which appear in video shots is a challenging and time-consuming task. Moreover, it is not possible to provide annotation for every concept in the real world. In this study, an integrated semantic-based approach for similarity computation is proposed with respect to enhance the retrieval effectiveness in concept-based video retrieval. The proposed method is based on the integration of knowledge-based and corpus-based semantic word similarity measures in order to retrieve video shots for concepts whose annotations are not available for the system. The TRECVID 2005 dataset is used for evaluation purpose, and the results of applying proposed method are then compared against the individual knowledge-based and corpus-based semantic word similarity measures which were utilized in previous studies in the same domain. The superiority of integrated similarity method is shown and evaluated in terms of Mean Average Precision (MAP)